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ABSTRACT 

A study compared the ninth-grade performance of 
students who were randomly admitted to New York City career magnet 
high schools to those who were randomly not offered seats in those 
schools. The research measured the effect of career magnets on 
students of average and low reading ability whose academic records 
were not strong enough to gain them admission to a selective magnet 
school. Analysis was based on results for 3,272 students with average 
reading scores and 986 students whose reading tests put them in the 
bottom 16 percent. Some of the results of the study were the 
following: (l) there was an extraordinarily high increase in high 
school enrollment of low readers who were assigned to freestanding 
career magnet programs; (2) in freestanding career magnets, low 
readers were two to four times more likely to pass the Regents 
mathematics test than similar students in comprehensive schools; (3) 
average readers in magnet schools increased their reading skills more 
than twice as much as comparable students in regular comprehensive 
schools; (4) average readers in freestanding magnets earned 
one-fourth more course credits than average students in comprehensive 
schools; and (5) poor readers in magnet schools did less well than 
their counterparts in comprehensive schools in reading ability and 
credits earned. Poor readers in magnet schools also had more 
absenteeism, probably because they had to transport themselves across 
the city using public transportation. The study concluded that career 
magnet programs lead to higher achievement and lower dropout rates 
for inner-city youth and that the random assignment press provides 
substantial opportunities for students who are usually turned away by 
magnet school admission committees. (KC) 
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a The Effectiveness of New 
York City's Career Magnet 
Schools 

Robert L Grain, Amy Heebner, and 
Yiu-Pong Si 

This Brief summarizes a report on the 
effects of a unique, large-scale, random 
assignment experiment in New York 
City's career magnet high schools. The 
schools that were studied accept half of 
their enrollment through a random-as- 
signment lottery conducted by the 
Educational Testing Service (ETS). The 
random assignment of students, with a 
omparable group randomly excluded, 
allowed for an evaluation based on a 
rigorous experimental design. This is the 
only certain methodology for determining 
whether students who attend these 
schools benefit from doing so because 
of the school, rather than because of the 
characteristics that they bring to the 
school. 
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choose their high school from the full 
range of New York City high schools. 

Ail eighth graders are required to com- 
plete an application for high school, 
even to attend their neighborhood 
school. Each student can make up to 
eight choices. They are also given two 
opportunities during the year to change 
their minds. A surprisingly large number 
choose to attend a school other than 
their neighborhood high school, and 
nearly 60 percent get their first choice. 
Three-fourths of the students who apply 
to magnet schools are accepted. 

New York City's career magnet high 
schools are not vocational schools; they 
combine career preparation with tradi- 
tional college preparation. Some of the 
career magnets are in their own dedi- 
cated buildings; o f ; iers are housed 
within regular neighborhood comprehen- 
sive schools as school s-withirva-school. 

The Random Assignment 
Experiment 



The report, the first of three, com- 
pares the ninth-grade performance of 
students who were randomly admitted to 
the career magnets with those who were 
randomly not offered seats in these 
schools. The research measured the ef- 
fect of career magnets on students of 
average and low reading ability whose 
academic records were not strong 
enough to gain them admission to a 
selective magnet school. The next two 
reports will present data on these same 
students as they go through their 
sophomore and junior years. 

New York City's Magnet Schools 

More than one-third of all New York 
City high school students attend one of 
the career magnet schools, and nearly 
every high school has a career magnet 
program. But career magnets are only 
one of several types of magnet high 
schools in New York. The city's program 
is so extensive that most high school stu- 
> dents attend magnets of one kind or 
& another. To maximize the number of ap- 
^ plicants to magnets, the school system 
'c offers every student the opportunity to 




Originally, New York's career magnets 
were selective. But the random assign- 
ment process was developed to expand 
the opportunity to attend these schools 
to students who would ordinarily not be 
selected. The schools are now permitted 
to select only half of their students; the 
other half are randomly assigned. 

To expand the opportunity even fur- 
ther, both the school-selected and the 
randomly-assigned groups must include 
fixed percentages of students with low, 
average, and high reading scores: six- 
teen percent from students with reading 
scores in the top sixth; sixteen percent 
from students with the lowest or missing 
reading scores; and the remainder from 
the large middle group of readers. (Stu- 
dents do not know whether they have 
been randomly-assigned or school- 
selected.) 



Publication and dissemination of 
this Brief is supported, in part, by 
funding from the William T. Grant 
Foundation Commission on Work, 
Family, and Citi? *>ship. 
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Analysis 

The analysis is based on results for 
3,272 students with average reading 
scores and 986 students whose reading 
tests put them in the bottom 16 percent, 
or who had not taken the required read- 
ing test. (For technical reasons, we were 
unable to construct a legitimate ex- 
perimental design for the top reading 
group). Ninety-one different school 
programs are included. 

Criteria 

We measured the impact of career 
magnets on five ninth-grade perfor- 
mance criteria: 

• percentage of students who entered 
high school after the eighth grade; 

• gain in reading scores; 

• attendance; 

• number of credits earned toward 
graduation; and 

• percentage passing the advanced 
("Regents") mathematics test. 

A, The results for students randomly 
assigned to career magnets, compared 
to the results for students who lost the 
lottery. (Note: For simplicity, we use the 
terms "lottery winners" and lottery 
losers" to refer to students who were 
randomly selected or randomly not 
selected. The New York City school 
system does not refer to the random 
assignment process as a lottery; nor 
does it call the students winners or 
losers.) 

7. High school enrollment 

• Of the lottery winners with average 
reading scores, 89 percent enrolled 
in high school the following year, 
compared to 86 percent of similar 

j students who were not offered seats. 

• Among students with low or missing 
reading scores, 83 percent of the lot- 
tery winners enrolled in high school, 
compared to only 77 percent of 
similar students who were not ran- 
domly selected. 

Not all of the students who do not en- 
roll in high school are dropouts. Some 
lottery losers may enroll in a private high 



school or attend ninth grade in their local 
junior high, which would result in a slight 
overestimation of the enrollment effect of 
career magnets. 

2. Gain in reading scores. 

• After one year in the career magnet 
program, students with average 
reading scores showed a sizeable 
improvement in their reading scores. 
In fact, they gained over twice as 
much in reading as did similar stu- 
dents in comprehensive programs. 

• Students with low or missing read- 
ing scores showed improvements in 
reading scores, but not as much as 
their counterpart lottery losers. 

3. Attendance. 

• For average readers, there was no 
statistically significant difference be- 
tween lottery winners and losers on 
this dimension. 

• Lottery winners with low reading 
scores had significantly more high 
school absences than comparable 
lottery losers. Many students who at- 
tend magnet schools have to travel 
long distances to other boroughs. 
This travel is not on regular school 
buses; students have to get themsel- 
ves to school on public subways 
and buses — a situation conducive to 
•stopping off." This is a dropout- 
prone group; though they manifest 
this tendency in increased absen- 

| ces, the/ have not dropped out to 
the extent that lottery losers have. 

4. Credits earned toward graduation. 

• Lottery winners with average read- 
ing scores earned significantly more 
credits toward graduation than those 
who did not win the lottery. 

• Lottery winners with low reading 
scores earned fewer credits than the 
lottery losers. 

5. Passing advanced ("Regents") 
I math test. 

• Average readers who won the lot- 
tery did no better than the lottery 
losers. 



• Poor readers who won the lottery 
showed a substantial, significant 
gain over the lottery losers. This is a 
clear indication that poor readers 
have been put into a more demand- 
ing curriculum than they would have 
received in a comprehensive school, 
where they may not even have 
taken the test. 

B. Total, or free-standing, magnets 
compared with magnets located within 
comprehensive schools. 

One can reasonably expect student 
outcomes to be better in free-standing 
magnets, where the whole school is 
devoted to a single career program or a 
cluster of career programs. A free-stand- 
ing magnet can develop a strong career 
focus because it has its own principal 
and does not have to conform to school- 
wide comprehensive school policies or 
compete with the school's comprehen- 
sive program for resources. 

1 . High schooi enrollment. 

• While eighth graders who are ad- 
mitted to either free-standing or 
school-within-school magnets are 
more likely to enroll in high school 
than the lottery losers, the effect of 
career magnet admission on enroll- 
ing is much stronger in the free- 

! standing career magnets, 

• Average readers who were as- 
signed to free-standing magnets 

I were slightly more likely to enroll in 

! high school than those who were as- 

i signed to magnets located within 

I comprehensive schools. 

! • The effect was especially strong for 
| students with low reading scores, 
j An extraordinarily high 90 percent of 
| the poor readers who were as- 
j signed to free-standing career mag- 
nets enrolled in high school. In con- 
trast, 80 percent of the poor readers 
who were assigned to magnets lo- 
| cated within comprehensive schools 
! enrolled in high school, virtually the 
• same enrollment percentage as the 
! lottery losers. 
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2. Gain in reading score* ;. 

• In both kinds of magnets, sfcxtents 
with average reading ability w >o 
won the lottery showed Improve- 
ments in reading greater than that of 
lottery losers, but their gate was 
larger in magnets located within 
comprehensive schools. 

• In contrast, students with low read- 
ing scores outperformed the tottery 
losers only in the free-standing 
career magnets. In magnets ocated 
within comprehensive schools, lot- 
tery winners with poor reading 
scores actually did less well than the 
lottery losers. 

3. Attendance. 

• Both lottery winners and lottery 
losers were absent more in high 
school than they had been in middle 
school. The increase in absen- 
teeism was greater for lottery win- 
ners with low reading scores, and 
was slightly greater in the total 
career magnets than in the ones lo- 
cated within comprehensive schools. 

A further study, not yet complete, indi- 
cates that some of the low readers feei 
less welcome in total career magnets. 
That plus the problem of traveling to 
school by themselves on subways, dis- 
cussed above, may explain the in- 
creased absenteeism of students with 
low reading ability in these schools. 

4. Credits earned toward graduation 

• Lottery winners with average read- 
ing ability earned significantly more 
credits than the lottery losers, but 
rnly in free-standing career mag- 
nets. 

• Whether they attend free-standing 
or within-school magnets, poor 
readers earned fewer credits than 
similar students who lost the lottery. 

5. Passing advanced ("Regents") 
math test. 

Students in the free-standing career 
magnets appear to be taking a more ad- 
vanced curriculum than their counter- 
parts in magnets located within com- 
prehensive schools. 



The Institute on Education and the Economy 
conducts research on the Implications of changes 
in the economy and job markets for all levels of 
our education and training system. 



• Average readers who won the lot- 
tery outperformed the lottery losers 
in this dimension only in the free- 
standing magnets. 

• In both kinds of career magnets, 
poor readers who won the lottery 
outperformed the lottery losers. 
Especially in free-standing magnets, 
poor readers are much more likely 
to take and pass the advanced math 
test than their counterpart lottery 
losers. 

Summary of Results 

We can safely conclude that New 
York City's career magnets significantly 
benefit students. Career magnets attract 
potential dropouts to high school and ex- 
pose them to a more demanding cur- 
riculum. For students with low reading 
scores, the results are mixed. They are 
much more likely to make the transition 
to high school, but their absentee rates 
go up higher than similar students who 
do not gain admission to the magnets. 
More of them pass an advanced math 
test, but those who attend magnets 
within comprehensive schools fall be- 
hind the lottery losers In reading. 

Many of the effects of career magnet 
programs are significantly large: 

• There was an extraordinarily high in- 
crease in high school enrollment of 
low readers who were assigned to 
free-standing magnets. They were 
much more likely to go on to high 
school than similar students who 
were not assigned to a magnet. 

• In free-standing career magnets, 
low readers are two to four times 
more likely to pass the Regents 
math test than similar students in 
comprehensive schools. 

• Average readers in magnet schools, 
whether in free-standing magnets or 
magnets-within-schools, increase 
their reading skills more than twice 
as much as comparable students in 
regular comprehensive schools. 

• Average readers in free-standing 
magnets earn one-fourth more 

q course credits than average stu- 

ERIC 



dents in comprehensive schools. 
Since lack of credits is a main cause 
of dropout, these students have con- 
siderably increased their chances of 
getting a diploma. 

• Two negative effects are also sig- 
nificant. In both reading ability and 
the number of credits earned, poor 
readers who won the tottery did less 
well than comparable students who 
lost the lottery. 

Discussion 

Among the career magnets, there are 
significant differences in their effective- 
ness. Since each program is a separate 
experiment, we looked for common fea- 
tures and examined their effects on stu- 
dent outcomes. It seems that when 
career magnets work, it is because of 
their career focus. The programs that 
produce the most positive student out- 
comes are the ones that take their 
career commitment most seriously. 

In both free-standing magnets and 
those wit! -n comprehensive schools, the 
most effective career magnet programs: 

• separate their students from the 
regular curriculum and from stu- 
dents who do not participate in the 
program's career focus and 

• provide students with special teach- 
ing and equipment. 

There is also some evidence that 
career magnets that provide substantial- 
ly more job placement activities are 
more effective, particularly in reaching 
poor readers. 

These conclusions are based on the 
following findings: 

1 . In schools that offer magnet stu- 
dents many specialized classes, the 
dropout rate in the transition from middle 
school to high school decreased. 

• In career magnet programs that had 
many separate classes, there was a 
very high increase in high school en- 
rollment of poor readers who won 

th i lottery compared to similar stu- 
dents who lost the lottery. 
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• In contrast, in career magnets that 
had fewer separate classes, poor 
readers who won the lottery were ac- 
tually less likely to enroll in high 
school than the lottery losers. 

Why do the career magnet programs 
with an emphasis on separate classes 
have such an impact on high school en- 
rollment for poor readers? Schools with 
many separate and specialized classes 
gain a reputation for a sharper career 
focus. Students who search out a pro- 
gram with a dear identity or career focus 
may often be students with doubts about 
going to high school; for these students, 
winning or losing the lottery seems often 
to mean the difference between going to 
high school and dropping out. 

2. Schools that provide many special 
sections of classes for magnet students 
are more successful at educating 
average readers than schools that pro- 
vide few such classes. 

• Lottery winners with average read- 
ing scores showed more improve- 
ment in reading than did com- 
parable lottery losers. This is true 
only where the program separates 
its students into many specialized 
course sections. Average readers in 
programs with many special sec- 
tions of classes improved their read- 
ing scores at over twice the rate of 
lottery losers in comprehensive 
schools. (Results for poor readers 
are similar but not statistically sig- 
nificant.) 

There are several possible explana- 
tions for these results. Since half the stu- 
dents in these sections may be hand- 
picked, highly-motivated teachers may 
volunteer to teach them. It may also be 
that the school, being committed to 
producing a unique product with its stu- 
dent body, is striving harder and 
demanding more from each class. And, 
in programs where there is a strong com- 
mitment to a theme or a career, the lot- 
tery winners themselves may be more 
motivated. This effect would then be 
magnified, since the concentration of 
motivated students would create a 
favorable classroom climate. 
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3. Career magnet schools that offer 
specialized dasses designed for only 
the students in the career magnet— that 
is, teaching the magnet students dif- 
ferent subjects— produce favorable 
results for average readers but not for 
poor readers. To test these effects, 
programs that provided over eight 
career-specific one-semester courses in 
four years were compared with those 
that had fewer than eight. 

• Average readers in programs thai of- 
fered more such classes earned 
more credits toward graduation than 
magnet students in programs that of- 
fered fewer such dasses. 

• Poor readers, however, did not ob- 
tain normal amounts of course credit 
in the programs with more spedal 
dasses. In contrast, poor readers in 
the p-ograms that offered fewer spe- 
dal dasses earned more credits. 

• The increasing absenteeism of poor 
readers seems to occur only in 
programs thai have more career- 
spedfic classes. Free-standing 
career magnets have more career- 
spedfic classes, and free-standing 
magnets frequently require a longer 
trip to school than the ones located 
within comprehensive schools. 

4. Schools that provide hands-on com- 
puter experience may be more success- 
ful in motivating students to attend 
school. 

• For students who are average 
readers, the presence of computer 
labs dramatically reduces absen- 
teeism. 

• For students with poor reading 
scores, this pattern does not ap- 
pear, perhaps because computers 
still involve manipulation of words 
and poor readers are weaker in ver- 
bal skills. 

i 

j 5. Schools that offer more placement 
efforts for graduates reduce dropout 
rates. 

• Poor readers have a much-reduced 
dropout rate (between middle school 
and ninth grade) in the career mag- 
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nets that provide substantially more 
job placement activities. 

In short, career magnets with a 
stronger career focus (1) motivate and 
improve the performance of students 
who are able to keep up with the higher 
work demands; (2) encourage students 
with low reading scores to enroll in high 
school; and (3) expose students of all 
levels of reading ability to a more 
demanding curriculum. 

We note two caveats: The first is that 
educators in the career magnets are 
divided on how to deal with weaker stu- 
dents. Some feel that career magnets 
are harmed by the presence of these stu- 
dents. Other teachers in these schools 
believe it is possible to solve the prob- 
lem by developing stronger remedial ser- 
vices. But career magnet programs do 
not get a larger budget than comprehen- 
sive schools and generally feel they 
need to spend whatever funds they have 
to provide special resources for their 
career focus. We do find that certain 
types of efforts are successful with stu- 
dents with low reading scores. For ex- 
ample, schools with strong employment 
placement programs are effective at 
redudng dropout rates among poor 
readers. More placement efforts could 
be adopted, but, given the limited 
budgets, this would involve tre^^-offs 
with other activities. 

Second, the fact that New York's 
career magnets provide an effective 
secondary school education does not tell 
us whether the entire group of high 
school students in New York, including 
those who are academically strong 
enough to be selected by magnet 
programs and those who are left behind 
in comprehensive schools, have ex- 
perienced a net benefit. This study did 
not measure effects on all students in 
New York. 

Nonetheless, the positive results in 
the career magnets are impressive. Stu- 
dents in a predominantly minority urban 
school system whose records would not 
have been good enough to gain admis- 
sion to a selective school made substan- 
tial progress. If further evaluations repli- 
cate these findings, New York City's 



experiment dearly shows, in an un- 
biased way, that: 

• career magnet programs lead to 
higher achievement and lower 

dropout rates for inner-city youth; 

• the random assignment process 
provides substantial opportunities 
for students who are usually turned 
away by magnet school admission 
committees. 

In these important respects, New York 
City's career magnet program can be a 
model for the nation's schools. 
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